`azurerm_databricks_workspace_serverless` - add resource and data source by v-yhyeo0202 · Pull Request #31695 · hashicorp/terraform-provider-azurerm

v-yhyeo0202 · 2026-02-06T08:53:42Z

Community Note

Please vote on this PR by adding a 👍 reaction to the original PR to help the community and maintainers prioritize for review
Please do not leave comments along the lines of "+1", "me too" or "any updates", they generate extra noise for PR followers and do not help prioritize for review

Description

New azurerm_databricks_workspace_serverless resource and data source are added. The resource corresponds to Azure Databricks with serverless compute_mode. This PR is built on top of commits from #31654. As compared to azurerm_databricks_workspace, the custom_properties property is omitted as all the child properties are not allowed when compute_mode is serverless.

PR Checklist

I have followed the guidelines in our Contributing Documentation.
I have checked to ensure there aren't other open Pull Requests for the same update/change.
I have checked if my changes close any open issues. If so please include appropriate closing keywords below.
I have updated/added Documentation as required written in a helpful and kind way to assist users that may be unfamiliar with the resource / data source.
I have used a meaningful PR title to help maintainers and other users understand this change and help prevent duplicate work.
For example: “resource_name_here - description of change e.g. adding property new_property_name_here”

Changes to existing Resource / Data Source

I have added an explanation of what my changes do and why I'd like you to include them (This may be covered by linking to an issue above, but may benefit from additional explanation).
I have written new tests for my resource or datasource changes & updated any relevant documentation.
I have successfully run tests with my changes locally. If not, please provide details on testing challenges that prevented you running the tests.
~~(For changes that include a state migration only). I have manually tested the migration path between relevant versions of the provider.~~

Testing

My submission includes Test coverage as described in the Contribution Guide and the tests pass. (if this is not possible for any reason, please include details of why you did or could not add test coverage)

https://hashicorp.teamcity.com/buildConfiguration/TF_AzureRM_AZURERM_SERVICE_PUBLIC_DATABRICKS/615695?buildTab=overview

Change Log

Below please provide what should go into the changelog (if anything) conforming to the Changelog Format documented here.

azurerm_databricks_workspace_serverless - add resource and data source

This is a (please select all that apply):

Bug Fix
New Feature (ie adding a service, resource, or data source)
Enhancement
Breaking Change

Related Issue(s)

Fixes #31218

Rollback Plan

If a change needs to be reverted, we will publish an updated version of the provider.

Note

If this PR changes meaningfully during the course of review please update the title and description as required.

…ndards` enum

…property

…space-serverless-draft-0

…n `make fmt; make terrafmt; make document-fix`

…i-lint`

…ted issues

…_key_vault_id`

alexott · 2026-02-10T07:09:29Z

What about naming it azurerm_databricks_serverless_workspace?

v-yhyeo0202 · 2026-02-10T07:40:24Z

What about naming it azurerm_databricks_serverless_workspace?

After some discussions, we decide to use the name azurerm_databricks_workspace_serverless due to the following reasons.

It aids searching and filtering, the search key "databricks_workspace" will match both azurerm_databricks_workspace and azurerm_databricks_workspace_serverless.
Easier to set acceptance test prefix, the TEST_PREFIX TestAccDatabricksWorkspace will match both.

gerrytan

Thank you @v-yhyeo0202 I haven't done complete review, but I left few concerns I have based on initial look at the design of this new resource.

gerrytan · 2026-02-16T00:50:50Z

+					ComputeMode:                workspaces.ComputeModeServerless,
+					Encryption:                 encryption,
+					EnhancedSecurityCompliance: r.expandDatabricksWorkspaceServerlessEnhancedSecurityComplianceDefinition(config.EnhancedSecurityCompliance),
+					PublicNetworkAccess:        &publicNetworkAccess,


Private endpoint connection is missing, but also not supported in databricks_workspace.

Can you please try the portal experience and determine if we should include private endpoint support in this PR, or as a separate follow up PR.

I try to create private endpoint connections in Databricks workspace networking Azure portal interface as shown above and compared this with the private endpoint connection created through TestAccDatabricksWorkspace_privateLink. The test configurations manage to create private endpoint connection with azurerm_private_endpoint, which I think should be same as the one created through privateEndpointConnection.

Currently the same private endpoint connection creation configurations are applied in TestAccDatabricksWorkspaceServerless_complete. However, after a more detailed check, I cannot find the similar steps to create private endpoint connection for Databricks serverless workspace through Azure portal. The serverless workspace seems to rely on different mechanism to establish private connection than hybrid workspace. I will investigate deeper into Databricks to find out the correct method to create private connection.

I have added TestAccDatabricksWorkspaceServerless_privateLink to validate the private endpoint creation in Databrick serverless workspace. It is tested that private endpoint can be created through the Terraform configuration listed in the test, similar as that created through Azure portal.

gerrytan · 2026-02-16T00:51:52Z

+					ComputeMode:                workspaces.ComputeModeServerless,
+					Encryption:                 encryption,
+					EnhancedSecurityCompliance: r.expandDatabricksWorkspaceServerlessEnhancedSecurityComplianceDefinition(config.EnhancedSecurityCompliance),
+					PublicNetworkAccess:        &publicNetworkAccess,


Please also call out in the PR description that we're intentionally omitting custom_properties because all sub-properties not supported in the serverless. Include a link to the REST API doc: https://learn.microsoft.com/en-us/rest/api/databricks/workspaces/create-or-update?view=rest-databricks-2026-01-01&tabs=HTTP#workspacecustomparameters

The information has been added.

gerrytan · 2026-02-16T02:35:37Z

+	return sdk.ResourceFunc{
+		Timeout: 30 * time.Minute,
+		Func: func(ctx context.Context, metadata sdk.ResourceMetaData) error {
+			ctx, cancel := context.WithTimeout(ctx, metadata.ResourceData.Timeout(schema.TimeoutCreate))


Is this ctx re-creation necessary? Normally we should just use the ctx passed from the function param

Initially, I add the ctx re-creation to call defer cancel() with the intention to release the resources associated with the context. However, after checking the code pattern of typed resource, I find that the defer cancel() code is not used. Since ctx is provided through function parameter as you mention, guess the plugin should be able to handle the releasing of resource. The ctx re-creation is removed.

gerrytan · 2026-02-16T02:46:04Z

+			Type:         pluginsdk.TypeString,
+			Optional:     true,
+			ValidateFunc: keyVaultValidate.KeyVaultChildID,
+		},


While I understand managed_services_cmk_key_vault_id and managed_services_cmk_key_vault_key_id are existing design from databricks_workspace, I don't like copying it into this new resource because it has inherent performance issue when the tenant has large amount of key vault / keys.

Let's check first if this is feasible and get agreement with HC before we proceed.

…I to 2026-01-01

…ink and remove context recreation

…erless-workspace

v-yhyeo0202 · 2026-02-19T10:01:30Z

Acceptance test results

venkad-intc · 2026-03-04T04:32:27Z

@v-yhyeo0202 @gerrytan Thank you for this.

Looking forward for this resource to be available. Any ETA would be helpful.

v-yhyeo0202 · 2026-03-04T07:17:40Z

@venkad-intc, the current ETA is by the end of March.

…kspaceServerless_privateLink`

…vate endpoint

venkad-intc · 2026-03-25T04:17:10Z

@v-yhyeo0202 Are we still on track for this EOM release?

v-yhyeo0202 · 2026-03-25T06:18:05Z

@venkad-intc there will be delay for the release due to ongoing schema design discussion. The new ETA is not decided yet. For temporary workaround, please use azapi_resource to create the resource. Let me know if you encounter issue in doing so.

v-yhyeo0202 added 13 commits February 3, 2026 16:52

Databricks - bump API version 2026-01-01

bb57759

azurerm_databricks_workspace - add `compliance_security_profile_sta…

d13b15e

…ndards` enum

azurerm_databricks_workspace - temporarily hardcode compute_mode …

18c62ff

…property

Revert unnecessary changes

6e1353c

azurerm_databricks_workspace - minor fix

82ddb52

azurerm_databricks_workspace - minor fix

066b303

Merge branch 'bump-databrick-api-2026-01-01' into add-databricks-work…

13bd518

…space-serverless-draft-0

Merge branch 'main' into bump-databrick-api-2026-01-01

e178597

Databricks - run make document-fix

2aef575

azurerm_databricks_virtual_network_peering - fix documentation

91e8bb6

Add azurerm_databricks_serverless_workspace resource and data source

662b7b5

azurerm_databricks_serverless_workspace - add documentations and ru…

9000032

…n `make fmt; make terrafmt; make document-fix`

azurerm_databricks_serverless_workspace - fix with azurerm-linter

ab910b9

github-actions Bot added documentation dependencies service/databricks state-migration size/XL waiting-response labels Feb 6, 2026

azurerm_databricks_serverless_workspace - fix according to `golangc…

fef0993

…i-lint`

github-actions Bot removed the waiting-response label Feb 6, 2026

v-yhyeo0202 added 2 commits February 6, 2026 20:37

azurerm_databricks_serverless_workspaces - fix managed service rela…

26855b1

…ted issues

azurerm_databricks_serverless_workspace - fix `managed_services_cmk…

fd4dc18

…_key_vault_id`

github-actions Bot added the waiting-response label Feb 9, 2026

azurerm_databricks_serverless_workspace - minor fix

7796fec

github-actions Bot removed the waiting-response label Feb 9, 2026

v-yhyeo0202 added 3 commits February 9, 2026 11:11

Databricks - minor fix

84c06b1

Databricks - minor fix

d3d3c4d

azurerm_databricks_serverless_workspace - minor fix

aa7dccb

v-yhyeo0202 requested a review from gerrytan February 9, 2026 05:13

v-yhyeo0202 added 3 commits February 10, 2026 08:22

azurerm_databricks_serverless_workspace - minor fix

adeaf16

Merge branch 'main' into add-databricks-serverless-workspace

63f1343

azurerm_databricks_workspace_serverless - fix resource name

ba756fb

v-yhyeo0202 changed the title ~~azurerm_databricks_serverless_workspace - add resource and data source~~ azurerm_databricks_workspace_serverless - add resource and data source Feb 10, 2026

gerrytan suggested changes Feb 16, 2026

View reviewed changes

github-actions Bot assigned gerrytan Feb 16, 2026

github-actions Bot added the waiting-response label Feb 16, 2026

v-yhyeo0202 added 6 commits February 19, 2026 13:10

Databricks - bump all Databricks 2022-10-01-preview and 2024-05-01 AP…

d692b82

…I to 2026-01-01

Remove unused entries from historical-exceptions.yml

21e085d

Merge branch 'main' into bump-databrick-api-2026-01-01

8e07972

Run make document-fix

798d732

azurerm_databricks_workspace_serverless - add acctest for private l…

028fcc8

…ink and remove context recreation

Merge branch 'bump-databrick-api-2026-01-01' into add-databricks-serv…

aa84175

…erless-workspace

github-actions Bot added service/data-factory tooling and removed waiting-response labels Feb 19, 2026

v-yhyeo0202 requested a review from gerrytan February 24, 2026 00:18

rcskosir added new-resource new-data-source labels Feb 24, 2026

v-yhyeo0202 added 4 commits March 10, 2026 16:42

azurerm_databricks_workspace_serverless - fix `TestAccDatabricksWor…

ec72fec

…kspaceServerless_privateLink`

azurerm_databricks_workspace_serverless - add example to create pri…

555062b

…vate endpoint

azurerm_databricks_workspace_serverless - add example to create pri…

2c13f24

…vate endpoint

azurerm_databricks_workspace_serverless - minor revision

3456480

Conversation

v-yhyeo0202 commented Feb 6, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Community Note

Description

PR Checklist

Changes to existing Resource / Data Source

Testing

Change Log

Related Issue(s)

Rollback Plan

Uh oh!

alexott commented Feb 10, 2026

Uh oh!

v-yhyeo0202 commented Feb 10, 2026

Uh oh!

gerrytan left a comment

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

v-yhyeo0202 commented Feb 19, 2026

Uh oh!

venkad-intc commented Mar 4, 2026

Uh oh!

v-yhyeo0202 commented Mar 4, 2026

Uh oh!

venkad-intc commented Mar 25, 2026

Uh oh!

v-yhyeo0202 commented Mar 25, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

6 participants

v-yhyeo0202 commented Feb 6, 2026 •

edited

Loading